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Detailed Action 

Background 

1. This action is responsive to the following communications: RCE filed on 
3/36/2007. 

2. Claims 1-20 are pending in this case. Claims 1, 19, and 20 are in 
independent form. Claims 1-2, 4-7, 9, 19, and 20 have been amended. 

3. The examiners rejections of claims 1-20 under 35 USC § 102(b) as being 
anticipated by Arora et al in the previous final office (dated 12/29/2006) have been 
withdrawn in view of Applicant's amendment, as specifically addressed in paragraphs 8 
and 9 of this Office Action. 

Claim Rejections - 35 USC S 102 

4. The following is a quotation of the appropriate paragraphs of 35 
U.S.C. 102 that form the basis for the rejections under this section made in this Office 
action- 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed 
publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of 
application for patent in the United States. 

5. Claims 1-12 and 19-20 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Engdahl (U.S. Pat. No. 6,282,455). 
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As to independent claim 1, Engdahl describe(s): A method for representing HMI 
user screens comprising the activities of via an information device ("...a computer...," 
col. 2, lines 31-33): obtaining an organization and a hierarchy of a collection 
("...Collecting objects...," col. 2, Une 67 - col. 3, line l) comprising a plurality of human 
machine interface (HMI) screen nodes ("...a graphic representation of a scene graph 
employed by the present invention to track the hierarchy and association of different 
spatially Unked objects the latter represented by nodes...," col. 3, lines 43*46), each of 
the plurality of HMI screen nodes a visual representation of a corresponding visual 
display of a human machine interface ("...viewing the visual display...," col. 2, lines 40- 
44) adapted to interpret communications from a human operator of an automated 
machine controller ("...for designing, programming, control and maintenance of factory 
processes..." col. 4, line 67 - col. 5, hne l); automatically determining an arrangement 
of the collection ("established automatically" col. 8 , Une 46); responsive to a detected 
colhsion between a parent node of said hierarchy of said collection and a leaf node of the 
parent node ("...is on top of another object..." col. 8, lines 25*26), automatically 
adjusting a position of said parent node ("...parent node connects to the child node's 
properties...," col. 8, lines 29-30); and rendering the collection according to the 
arrangement ("...rendering the scene...," col. 3, Une 49). 

As to dependent claim 2, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising calculating a position of the leaf 
node ("...each nodes spatial coordinates are defined relative to its parent node and 
hence children nodes "move" with the parent node when the coordinates of the parent 
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node are changed. Generally the coordinates include x, y and z Cartesian coordinates as 
well as rotative coordinates of roll, yaw, and pitch. This allows visual objects, 
represented by children nodes, to be placed "withthin" other visual objects represented 
by parent nodes...," col. 5, lines 32*33). 

As to dependent claim 3, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising calculating a position of a visible 
leaf ("...coordinates including] x, y and z Cartesian coordinates [of] visual objects , 
represented by children nodes," col. 5, lines 37-39)(emphasis added). 

As to dependent claim 4, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising calculating the position of the 
parent ("...coordinates [of] parent node..." col. 5, lines 32-33). 

As to dependent claim 5, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising detecting the collision ("...if the 
culmination of the drag-drop operation is that the selected object 64 is on top of another 
object 64, then the objects 64 of the child node takes its arguments from the parent 
node's properties and, if necessary, the parent node connects to the child node's 
properties. col. 8, lines 25-30)(emphasis added). 

As to dependent claim 6, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising updating the position of the parent 
("...the parent node connects to the child node's properties..." col. 8, Unes 29-30). 
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As to dependent claim 7, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising updating the position of the parent 
(",..the parent node connects to the child node's properties... automatically...," col. 8, 
Unes 25-30 and 46) upon detecting the collision ("if... the drag-drop operation is that the 
selected object 64 is on top of another object... the parent node connects to the child 
node's properties... automatically...," col. 8, lines 25-30 and 46). 

As to dependent claim 8, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising recursively calculating a position 
of each of the plurality of HMI screen nodes ("... respond to the operation of the 
computer node, again through a linking of properties...," col. 6 lines 24-27)(emphasis 
added). 

As to dependent claim 9, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 further comprising recursively calculating a position 
of each of the plurality of HMI screen nodes ("...respond to the operation of the 
computer node, again through a linking of properties...," col. 6 lines 24-27)(emphasis 
added) and updating the position of the parent upon detecting the collision ("if... the 
drag-drop operation is that the selected object 64 is on top of another object... the parent 
node connects to the child node's properties... automatically...," col. 8, lines 25-30 and 
46). 

As to dependent claims 10 and 11, which depend from claim 1, EngdahHurther 
disclose(s): the method of claim 1 further comprising changing a visibility of a node and 
children of the node ("visibility of a particular object 64 may be changed through the 
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node editor 78 receiving cursor commands from the devices 24 " col. 7, lines 39-47; see 
also, "...each node includes the property of visibility and thus its associated object may 
become invisible or transparent allowing this nesting of objects in other objects to be 
properly displayed on the visual display 22 and the display to be simplified when all 
components to nodes need not be displayed....," col. 6, lines 40-45)(emphasis added). 

As to dependent claim 12, which depends from claim 1, Engdahl further 
disclose(s): the method of claim 1 wherein the arrangement is a tree arrangement ("...in 
which scene elements are arranged as nodes on a tree structure ...," col. 5, lines 25- 
27)(emphasis added). 

As to independent claim 19, this claim differs from claim 1 only in that it is directed 
to a product defined by the process of claim 1. Accordingly, this claim is rejected for the 
same reasons set forth in the treatment of claim 1, above. 

As to independent claim 20, this claim differs from claim 1 only in that it is directed 

to an apparatus for carrying out the process of claim 1, EngdahJ further disclose(s): 

[A]n industrial control system [a] central control unit [ilncluding a 
central processing unit [a] communications adapter [a] terminal 20 
providing a visual display 22 and one or more user input devices 
[ilnput device 24 may be a conventional keyboard and mouse, or a 
spaceball...a common network [and] one or more remote units (col. 3, 
Une 57 to col. 4, line 26). 

Accordingly, this claim is rejected for the same reasons set forth in the treatment of claim 1, 
above. 
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Claim Rejections • 35 USC $ 103 

6. . The following is a quotation of 35 U.S.C. 103(a) which forms the basis 
for all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not 
identically disclosed or described as set forth in section 102 of 
this title, if the differences between the subject matter sought 
to be patented and the prior art are such that the subject matter 
as a whole would have been obvious at the time the invention was 
made to a person having ordinary skill in the art to which said 
subject matter pertains. Patentability shall not be negatived by 
the manner in which the invention was made, 

7. Claims 13-18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over EngdahI{\J,S. Fat. No. 6,282,455) in view of Chapman et al 
(U.S. Pre-Grant Publication 2004/0021679) and Arora et al (US Pat. No. 
5,911,145). 

As to dependent claims 13 and 14, which depend from claim 1, Engdahl taught 
the method for representing HMI user screens in an inforination device ("...a 
computer...," col.. 2, lines 31-33; see also discussion of claim 20, above), obtaining the 
organization and a hierarchy of a collection ("...Collecting objects...," col. 2, line 67 - col. 
3, Hne l), the plurality of human machine interface (HMI) screen nodes ("...a graphic 
representation of a scene graph employed by the present invention to track the 
hierarchy and association of different spatially linked objects the latter represented by 
nodes...," col. 3, lines 43-46), each of the plurality of HMI screen nodes a visual 
representation of the corresponding visual display of a human machine interface 
("...viewing the visual display...," col. 2, lines 40*44) adapted to interpret 
communications from the human operator of the automated machine controller ("...for 
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designing, programming, control and maintenance of factory processes..." col. 4, line 67 
- col. 5, line l); automatically determining an arrangement of the collection (e.g. 
"established automatically" col. 8 , line 46), being responsive to a detected colhsion 
between the parent node of said hierarchy of said collection and the leaf node of the 
parent node ("...is on top of another object..." col. 8, lines 25-26), automatically 
adjusting a position of said parent node ("...parent node connects to the child node's 
properties...," col. 8, Unes 29-30); and rendering the collection according to the 
arrangement ("...rendering the scene...," col. 3, line 49). 

Engdahl arguably fails to clearly show that the arrangement is either: (l) a 
vertical tree arrangement; or (2) a horizontal tree arrangement. 

Arora et al. is cited for teaching an arrangement of a vertical tree, as 
illustrated in figure 21 id. 




FIG. 21 
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Arora et al. further teaches a horizontal tree arrangement, as illustrated in 
figure 20 id. 
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FIG. 20 



Arora et al does not teach the vertical and horizontal tree arrangements for 
configuring an HMI. Instead, the vertical and horizontal tree arrangements are for 
HTML pages of a web site. 

Chapman et al teaches "a human machine interface (HMI)" (para. [000 1]) 
including "a display page including a plurality of display page elements" (para. [0025]) 
where "[p]referably,.the display page is HTML based" (para. [0040]). 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made, to have combined the vertical and horizontal tree arrangements of 
Arora et al with the HMI editor of Engdahl hecsiuse of the teachings in Chapman et al 
and knowledge of persons of ordinary skill in the art. More specifically, Chapman et al 
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suggests the use of HTML display pages for "[bletter integration between the operator 
HMI and other business systems. Business systems are undoubtedly moving towards 
greater integration with the web," para. [0226]). The level of ordinary skill coupled with 
the level of knowledge in the art at the time of the invention .(evidenced in these three 
references) was such that their existed a reasonable expectation of success in the above 
combination (e.g. "In addition, the latest version of MSHTML includes many new 
features that are pivotal in making it suitable as a basis for . an industrial HMI 
architecture...," para. [0240]). Additionally, Engdahl, Chapman et al, and Arora et al 
are in analogous art as they all are directed to the same field of endeavor of configuring 
user interfaces using markup languages. 

As to dependent claims 15-17, Arora et al further disclosed the method of claim 
1, wherein the arrangement is rendered with equal inter-generational node spacing, 
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equal intra-generational node spacing, and each parent aligned centrally to all children 
of that parent ■ as illustrated in figure 4. 

As to dependent claim 18, Arora et ah further disclosed the method of claim 1, 
wherein the arrangement is rendered with all nuclear children separated equally, as 
illustrated in figure 4. 
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Response to Arguments 

8. Applicant's arguments with respect to rejection of claims 1-20, see p. 7 of 
Applicants RCE (dated 3/26/2007), have been considered but are moot in view of the 
new grounds of rejection. 
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9. Applicant's argues persuasively that, with respect to the claims as 
amended, Arora et al, is not directed to a method for editing HMI screen nodes for use 
by a human operator of an industrial plant to an automated machine controller. 
Accordingly, the previous rejections under 35 USC §102 are withdrawn. 

Conclusion 

10. Although not relied upon, the following prior art is made of record because 
it considered pertinent to apphcant's disclosure: 



Computer screen and memory organization 
enabling presentation of a tree. 
Multiple aspect operator interface for displaying 
fault diagnostics results in intelligent process 
control systems. 

Library manager for automated programming of 
industrial controls.. 

Method and an apparatus for editing tree 
structures in display. 

Method and apparatus for providing attribute 
nodes in a graphical data flow environment. 
Method and apparatus for organizing objects of a 
network map. 

Method in a structure editor 

Animation of a configuration diagram to visually 

indicate deployment of programs. 

Man/machine interface graphical code generation 

wizard for automatically creating MMl graphical 

programs. 

Reconfigurable measurement system utilizing a 

programmable hardware element and fixed 

hardware resources. 

Network-based system for configuring a 

measurement system using configuration 

information generated based on a user 

specification. 

Control system and method therefor 

Graphical human-machine interface on a portable 

device. 

Industrial plant asset management system: 
apparatus and method. 



Schuuri Adrianus 


US 5606654 A 


Sztipanovits; Janos et al. 


US 5420977 A 


Havner; Randall A. et al. 


US 6854111 Bl 


Tatsumi; Tetsu et al. 


US 5432897 A 


McKaskle; Greg et al. 


US 5481741 A 


Grau; Stephen H. et al. 


US 6067093 A 


Arcuri; Anthony J. et al. 
Sha.h Kamran et al. 


US 5493678 A 

US 20030101021 Al 


McDonald; Ryan 0. et al. 


US 6053951 A 


Odom, Brian Keith et al. 


US 20030163298 Al 


Fuller, David W. Ill et al. 


US 20030036876 Al 


Weber; Patrick et al. 
Elsbree; et al. 


US 7171281 B2 
US 7017116 B2 


Spriggs, Bob et al. 


US 20030023518 Al 
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Spriggs, Bob et al. US 20030028269 Al Industrial plant asset management system^ 

apparatus and method. 

Bachman, George E. et US 20030217053 Al Context control mechanism for data executed in 
al. workflows of process, factory-floor, environmental, 

computer aided manufacturing-based or other 

control system. 

Dove; Andrew P. et al. US 6078320 A System for configuring a process control 

environment. 

Dove; Andrew P. et al. US 5838563 A System for configuring a process control 

environment. 



11. Any inquiry concerning this communication or earlier communications 
from the Examiner should be directed to Samir Termanini whose telephone number is 
(571) 270-1047. The Examiner can normally be reached from 9 A.M. to 4 P.M., Monday 
through Friday (excluding alternating Fridays). 

If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, Stephen 8. Hong can be reached on (571) 272*4124. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR 
only. For more information about the PAIR system, see http7/pair-direct.uspto.gov. 
Should you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, caU 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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